Serveur d'exploration autour du Bourgeois gentilhomme

Attention, ce site est en cours de développement !
Attention, site généré par des moyens informatiques à partir de corpus bruts.
Les informations ne sont donc pas validées.

Exploring the synergy between knowledge graph and computer vision for personalisation systems

Identifieur interne : 000006 ( France/Analysis ); précédent : 000005; suivant : 000007

Exploring the synergy between knowledge graph and computer vision for personalisation systems

Auteurs : Vincent Lully [France] ; Philippe Laublet [France] ; Milan Stankovic [France] ; Filip Radulovic [France]

Source :

RBID : Hal:hal-02187044

English descriptors

Abstract

In this paper, we explore the synergy between knowledge graph technologies and computer vision tools for personalisation systems. We propose two image user profiling approaches which map an image to knowledge graph entities representing the interests of a user who appreciates the image. The first one maps an image to entities which correspond to the objects appearing in the image. The second maps to entities which are depicted by visually similar images and which exist in the conceptual scope of the dataset within which further personalisation tasks are conducted. We show the superiority of our second approach against the baseline Google Cloud Vision API (label detection and web entity detection) in terms of accuracy metrics (precision, recall, MRR, nDCG). We also argue the importance of the capacity to create semantically useful profiles as the essence of many knowledge-or semantic-based personalisation systems is the semantic similarity calculation. We then apply our profiling approach in a novel personalisation use case where we seek to select the most appropriate images to display in recommendation banners. Our proposed knowledge-based approach tries to select the images which are the most in line with the semantic user profiles. We hypothesise that this image selection strategy allows to improve the user's perception of the recommended items. We conduct a two-stage user study with a real commercial travel dataset (1,357 package tours in 136 countries and regions depicted by 11,614 images). The results of 32 participants allow us to observe the promising performance of our approach in terms of persuasion, attention, efficiency and affinity. Abstract In this paper, we explore the synergy between knowledge graph technologies and computer vision tools for personalisation systems. We propose two image user profiling approaches which map an image to knowledge graph entities representing the interests of a user who appreciates the image. The first one maps an image to entities which correspond to the objects appearing in the image. The second maps to entities which are depicted by visually similar images and which exist in the conceptual scope of the dataset within which further personalisation tasks are conducted. We show the superiority of our second approach against the baseline Google Cloud Vision API (label detection and web entity detection) in terms of accuracy metrics (precision, recall, MRR, nDCG). We also argue the importance of the capacity to create semantically useful profiles as the essence of many knowledge-or semantic-based personalisation systems is the semantic similarity calculation. We then apply our profiling approach in a novel personalisation use case where we seek to select the most appropriate images to display in recommendation banners. Our proposed knowledge-based approach tries to select the images which are the most in line with the semantic user profiles. We hypothesise that this image selection strategy allows to improve the user's perception of the recommended items. We conduct a two-stage user study with a real commercial travel dataset (1,357 package tours in 136 countries and regions depicted by 11,614 images). The results of 32 participants allow us to observe the promising performance of our approach in terms of persuasion, attention, efficiency and affinity.


Url:
DOI: 10.1016/j.procs.2018.09.017


Affiliations:


Links toward previous steps (curation, corpus...)


Links to Exploration step

Hal:hal-02187044

Le document en format XML

<record>
<TEI>
<teiHeader>
<fileDesc>
<titleStmt>
<title xml:lang="en">Exploring the synergy between knowledge graph and computer vision for personalisation systems</title>
<author>
<name sortKey="Lully, Vincent" sort="Lully, Vincent" uniqKey="Lully V" first="Vincent" last="Lully">Vincent Lully</name>
<affiliation wicri:level="1">
<hal:affiliation type="laboratory" xml:id="struct-542233" status="VALID">
<orgName>Sens, Texte, Informatique, Histoire</orgName>
<orgName type="acronym">STIH</orgName>
<desc>
<address>
<addrLine>1 rue Victor Cousin 75230 Paris cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.stih.paris-sorbonne.fr/</ref>
</desc>
<listRelation>
<relation name="EA4509" active="#struct-413221" type="direct"></relation>
</listRelation>
<tutelles>
<tutelle name="EA4509" active="#struct-413221" type="direct">
<org type="institution" xml:id="struct-413221" status="VALID">
<orgName>Sorbonne Université</orgName>
<orgName type="acronym">SU</orgName>
<date type="start">2018-01-01</date>
<desc>
<address>
<addrLine>21 rue de l’École de médecine - 75006 Paris</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.sorbonne-universite.fr/</ref>
</desc>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>France</country>
</affiliation>
</author>
<author>
<name sortKey="Laublet, Philippe" sort="Laublet, Philippe" uniqKey="Laublet P" first="Philippe" last="Laublet">Philippe Laublet</name>
<affiliation wicri:level="1">
<hal:affiliation type="laboratory" xml:id="struct-542233" status="VALID">
<orgName>Sens, Texte, Informatique, Histoire</orgName>
<orgName type="acronym">STIH</orgName>
<desc>
<address>
<addrLine>1 rue Victor Cousin 75230 Paris cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.stih.paris-sorbonne.fr/</ref>
</desc>
<listRelation>
<relation name="EA4509" active="#struct-413221" type="direct"></relation>
</listRelation>
<tutelles>
<tutelle name="EA4509" active="#struct-413221" type="direct">
<org type="institution" xml:id="struct-413221" status="VALID">
<orgName>Sorbonne Université</orgName>
<orgName type="acronym">SU</orgName>
<date type="start">2018-01-01</date>
<desc>
<address>
<addrLine>21 rue de l’École de médecine - 75006 Paris</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.sorbonne-universite.fr/</ref>
</desc>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>France</country>
</affiliation>
</author>
<author>
<name sortKey="Stankovic, Milan" sort="Stankovic, Milan" uniqKey="Stankovic M" first="Milan" last="Stankovic">Milan Stankovic</name>
<affiliation wicri:level="1">
<hal:affiliation type="laboratory" xml:id="struct-542233" status="VALID">
<orgName>Sens, Texte, Informatique, Histoire</orgName>
<orgName type="acronym">STIH</orgName>
<desc>
<address>
<addrLine>1 rue Victor Cousin 75230 Paris cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.stih.paris-sorbonne.fr/</ref>
</desc>
<listRelation>
<relation name="EA4509" active="#struct-413221" type="direct"></relation>
</listRelation>
<tutelles>
<tutelle name="EA4509" active="#struct-413221" type="direct">
<org type="institution" xml:id="struct-413221" status="VALID">
<orgName>Sorbonne Université</orgName>
<orgName type="acronym">SU</orgName>
<date type="start">2018-01-01</date>
<desc>
<address>
<addrLine>21 rue de l’École de médecine - 75006 Paris</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.sorbonne-universite.fr/</ref>
</desc>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>France</country>
</affiliation>
</author>
<author>
<name sortKey="Radulovic, Filip" sort="Radulovic, Filip" uniqKey="Radulovic F" first="Filip" last="Radulovic">Filip Radulovic</name>
<affiliation wicri:level="1">
<hal:affiliation type="institution" xml:id="struct-504014" status="INCOMING">
<orgName>Sépage</orgName>
<desc>
<address>
<addrLine>27 Rue du Chemin Vert, 75011 Paris</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://sepage.fr/</ref>
</desc>
</hal:affiliation>
<country>France</country>
</affiliation>
</author>
</titleStmt>
<publicationStmt>
<idno type="wicri:source">HAL</idno>
<idno type="RBID">Hal:hal-02187044</idno>
<idno type="halId">hal-02187044</idno>
<idno type="halUri">https://hal.sorbonne-universite.fr/hal-02187044</idno>
<idno type="url">https://hal.sorbonne-universite.fr/hal-02187044</idno>
<idno type="doi">10.1016/j.procs.2018.09.017</idno>
<date when="2018">2018</date>
<idno type="wicri:Area/Hal/Corpus">000004</idno>
<idno type="wicri:Area/Hal/Curation">000004</idno>
<idno type="wicri:Area/Hal/Checkpoint">000007</idno>
<idno type="wicri:explorRef" wicri:stream="Hal" wicri:step="Checkpoint">000007</idno>
<idno type="wicri:Area/Main/Merge">000006</idno>
<idno type="wicri:Area/Main/Curation">000006</idno>
<idno type="wicri:Area/Main/Exploration">000006</idno>
<idno type="wicri:Area/France/Extraction">000006</idno>
</publicationStmt>
<sourceDesc>
<biblStruct>
<analytic>
<title xml:lang="en">Exploring the synergy between knowledge graph and computer vision for personalisation systems</title>
<author>
<name sortKey="Lully, Vincent" sort="Lully, Vincent" uniqKey="Lully V" first="Vincent" last="Lully">Vincent Lully</name>
<affiliation wicri:level="1">
<hal:affiliation type="laboratory" xml:id="struct-542233" status="VALID">
<orgName>Sens, Texte, Informatique, Histoire</orgName>
<orgName type="acronym">STIH</orgName>
<desc>
<address>
<addrLine>1 rue Victor Cousin 75230 Paris cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.stih.paris-sorbonne.fr/</ref>
</desc>
<listRelation>
<relation name="EA4509" active="#struct-413221" type="direct"></relation>
</listRelation>
<tutelles>
<tutelle name="EA4509" active="#struct-413221" type="direct">
<org type="institution" xml:id="struct-413221" status="VALID">
<orgName>Sorbonne Université</orgName>
<orgName type="acronym">SU</orgName>
<date type="start">2018-01-01</date>
<desc>
<address>
<addrLine>21 rue de l’École de médecine - 75006 Paris</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.sorbonne-universite.fr/</ref>
</desc>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>France</country>
</affiliation>
</author>
<author>
<name sortKey="Laublet, Philippe" sort="Laublet, Philippe" uniqKey="Laublet P" first="Philippe" last="Laublet">Philippe Laublet</name>
<affiliation wicri:level="1">
<hal:affiliation type="laboratory" xml:id="struct-542233" status="VALID">
<orgName>Sens, Texte, Informatique, Histoire</orgName>
<orgName type="acronym">STIH</orgName>
<desc>
<address>
<addrLine>1 rue Victor Cousin 75230 Paris cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.stih.paris-sorbonne.fr/</ref>
</desc>
<listRelation>
<relation name="EA4509" active="#struct-413221" type="direct"></relation>
</listRelation>
<tutelles>
<tutelle name="EA4509" active="#struct-413221" type="direct">
<org type="institution" xml:id="struct-413221" status="VALID">
<orgName>Sorbonne Université</orgName>
<orgName type="acronym">SU</orgName>
<date type="start">2018-01-01</date>
<desc>
<address>
<addrLine>21 rue de l’École de médecine - 75006 Paris</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.sorbonne-universite.fr/</ref>
</desc>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>France</country>
</affiliation>
</author>
<author>
<name sortKey="Stankovic, Milan" sort="Stankovic, Milan" uniqKey="Stankovic M" first="Milan" last="Stankovic">Milan Stankovic</name>
<affiliation wicri:level="1">
<hal:affiliation type="laboratory" xml:id="struct-542233" status="VALID">
<orgName>Sens, Texte, Informatique, Histoire</orgName>
<orgName type="acronym">STIH</orgName>
<desc>
<address>
<addrLine>1 rue Victor Cousin 75230 Paris cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.stih.paris-sorbonne.fr/</ref>
</desc>
<listRelation>
<relation name="EA4509" active="#struct-413221" type="direct"></relation>
</listRelation>
<tutelles>
<tutelle name="EA4509" active="#struct-413221" type="direct">
<org type="institution" xml:id="struct-413221" status="VALID">
<orgName>Sorbonne Université</orgName>
<orgName type="acronym">SU</orgName>
<date type="start">2018-01-01</date>
<desc>
<address>
<addrLine>21 rue de l’École de médecine - 75006 Paris</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.sorbonne-universite.fr/</ref>
</desc>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>France</country>
</affiliation>
</author>
<author>
<name sortKey="Radulovic, Filip" sort="Radulovic, Filip" uniqKey="Radulovic F" first="Filip" last="Radulovic">Filip Radulovic</name>
<affiliation wicri:level="1">
<hal:affiliation type="institution" xml:id="struct-504014" status="INCOMING">
<orgName>Sépage</orgName>
<desc>
<address>
<addrLine>27 Rue du Chemin Vert, 75011 Paris</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://sepage.fr/</ref>
</desc>
</hal:affiliation>
<country>France</country>
</affiliation>
</author>
</analytic>
<idno type="DOI">10.1016/j.procs.2018.09.017</idno>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc>
<textClass>
<keywords scheme="mix" xml:lang="en">
<term>DBpedia</term>
<term>Knowledge graph</term>
<term>computer vision</term>
<term>e-tourism</term>
<term>e-tourism Keywords: Knowledge graph</term>
<term>image user profiling</term>
<term>personalisation</term>
<term>recommeder system</term>
</keywords>
</textClass>
</profileDesc>
</teiHeader>
<front>
<div type="abstract" xml:lang="en">
<p>In this paper, we explore the synergy between knowledge graph technologies and computer vision tools for personalisation systems. We propose two image user profiling approaches which map an image to knowledge graph entities representing the interests of a user who appreciates the image. The first one maps an image to entities which correspond to the objects appearing in the image. The second maps to entities which are depicted by visually similar images and which exist in the conceptual scope of the dataset within which further personalisation tasks are conducted. We show the superiority of our second approach against the baseline Google Cloud Vision API (label detection and web entity detection) in terms of accuracy metrics (precision, recall, MRR, nDCG). We also argue the importance of the capacity to create semantically useful profiles as the essence of many knowledge-or semantic-based personalisation systems is the semantic similarity calculation. We then apply our profiling approach in a novel personalisation use case where we seek to select the most appropriate images to display in recommendation banners. Our proposed knowledge-based approach tries to select the images which are the most in line with the semantic user profiles. We hypothesise that this image selection strategy allows to improve the user's perception of the recommended items. We conduct a two-stage user study with a real commercial travel dataset (1,357 package tours in 136 countries and regions depicted by 11,614 images). The results of 32 participants allow us to observe the promising performance of our approach in terms of persuasion, attention, efficiency and affinity. Abstract In this paper, we explore the synergy between knowledge graph technologies and computer vision tools for personalisation systems. We propose two image user profiling approaches which map an image to knowledge graph entities representing the interests of a user who appreciates the image. The first one maps an image to entities which correspond to the objects appearing in the image. The second maps to entities which are depicted by visually similar images and which exist in the conceptual scope of the dataset within which further personalisation tasks are conducted. We show the superiority of our second approach against the baseline Google Cloud Vision API (label detection and web entity detection) in terms of accuracy metrics (precision, recall, MRR, nDCG). We also argue the importance of the capacity to create semantically useful profiles as the essence of many knowledge-or semantic-based personalisation systems is the semantic similarity calculation. We then apply our profiling approach in a novel personalisation use case where we seek to select the most appropriate images to display in recommendation banners. Our proposed knowledge-based approach tries to select the images which are the most in line with the semantic user profiles. We hypothesise that this image selection strategy allows to improve the user's perception of the recommended items. We conduct a two-stage user study with a real commercial travel dataset (1,357 package tours in 136 countries and regions depicted by 11,614 images). The results of 32 participants allow us to observe the promising performance of our approach in terms of persuasion, attention, efficiency and affinity.</p>
</div>
</front>
</TEI>
<affiliations>
<list>
<country>
<li>France</li>
</country>
</list>
<tree>
<country name="France">
<noRegion>
<name sortKey="Lully, Vincent" sort="Lully, Vincent" uniqKey="Lully V" first="Vincent" last="Lully">Vincent Lully</name>
</noRegion>
<name sortKey="Laublet, Philippe" sort="Laublet, Philippe" uniqKey="Laublet P" first="Philippe" last="Laublet">Philippe Laublet</name>
<name sortKey="Radulovic, Filip" sort="Radulovic, Filip" uniqKey="Radulovic F" first="Filip" last="Radulovic">Filip Radulovic</name>
<name sortKey="Stankovic, Milan" sort="Stankovic, Milan" uniqKey="Stankovic M" first="Milan" last="Stankovic">Milan Stankovic</name>
</country>
</tree>
</affiliations>
</record>

Pour manipuler ce document sous Unix (Dilib)

EXPLOR_STEP=$WICRI_ROOT/Wicri/Musique/explor/BourgeoisGentilV1/Data/France/Analysis
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000006 | SxmlIndent | more

Ou

HfdSelect -h $EXPLOR_AREA/Data/France/Analysis/biblio.hfd -nk 000006 | SxmlIndent | more

Pour mettre un lien sur cette page dans le réseau Wicri

{{Explor lien
   |wiki=    Wicri/Musique
   |area=    BourgeoisGentilV1
   |flux=    France
   |étape=   Analysis
   |type=    RBID
   |clé=     Hal:hal-02187044
   |texte=   Exploring the synergy between knowledge graph and computer vision for personalisation systems
}}

Wicri

This area was generated with Dilib version V0.6.33.
Data generation: Sun Sep 29 22:08:28 2019. Site generation: Mon Mar 11 10:07:23 2024